Data-fed, needs-driven : designing analytical workflows fit for disease surveillance

Syndromic surveillance has been an important driver for the incorporation of “big data analytics” into animal disease surveillance systems over the past decade. As the range of data sources to which automated data digitalization can be applied continues to grow, we discuss how to move beyond questions around the means to handle volume, variety and velocity, so as to ensure that the information generated is fit for disease surveillance purposes. We make the case that the value of data-driven surveillance depends on a "needs-driven" design approach to data digitalization and information delivery and highlight some of the current challenges and research frontiers in syndromic surveillance

Data-fed, needs-driven: Designing analytical workflows fit for disease surveillance

Syndromic surveillance has been an important driver for the incorporation of “big data analytics” into animal disease surveillance systems over the past decade. As the range of data sources to which automated data digitalization can be applied continues to grow, we discuss how to move beyond questions around the means to handle volume, variety and velocity, so as to ensure that the information generated is fit for disease surveillance purposes. We make the case that the value of data-driven surveillance depends on a “needs-driven” design approach to data digitalization and information delivery and highlight some of the current challenges and research frontiers in syndromic surveillance

Veterinary syndromic surveillance : current initiatives and potential for development

This paper reviews recent progress in the development of syndromic surveillance systems for veterinary medicine. Peer-reviewed and grey literature were searched in order to identify surveillance systems that explicitly address outbreak detection based on systematic monitoring of animal population data, in any phase of implementation. The review found that developments in veterinary syndromic surveillance are focused not only on animal health, but also on the use of animals as sentinels for public health, representing a further step towards One Medicine. The main sources of information are clinical data from practitioners and laboratory data, but a number of other sources are being explored. Due to limitations inherent in the way data on animal health is collected, the development of veterinary syndromic surveillance initially focused on animal health data collection strategies, analyzing historical data for their potential to support systematic monitoring, or solving problems of data classification and integration. Systems based on passive notification or data transfers are now dealing with sustainability issues. Given the ongoing barriers in availability of data, diagnostic laboratories appear to provide the most readily available data sources for syndromic surveillance in animal health. As the bottlenecks around data source availability are overcome, the next challenge is consolidating data standards for data classification, promoting the integration of different animal health surveillance systems, and also the integration to public health surveillance. Moreover, the outputs of systems for systematic monitoring of animal health data must be directly connected to real-time decision support systems which are increasingly being used for disease management and control

Syndromic surveillance using veterinary laboratory data : algorithm combination and customization of alerts

Background: Syndromic surveillance research has focused on two main themes: the search for data sources that can provide early disease detection; and the development of efficient algorithms that can detect potential outbreak signals. Methods: This work combines three algorithms that have demonstrated solid performance in detecting simulated outbreak signals of varying shapes in time series of laboratory submissions counts. These are: the Shewhart control charts designed to detect sudden spikes in counts; the EWMA control charts developed to detect slow increasing outbreaks; and the Holt-Winters exponential smoothing, which can explicitly account for temporal effects in the data stream monitored. A scoring system to detect and report alarms using these algorithms in a complementary way is proposed. Results: The use of multiple algorithms in parallel resulted in increased system sensitivity. Specificity was decreased in simulated data, but the number of false alarms per year when the approach was applied to real data was considered manageable (between 1 and 3 per year for each of ten syndromic groups monitored). The automated implementation of this approach, including a method for on-line filtering of potential outbreak signals is described. Conclusion: The developed system provides high sensitivity for detection of potential outbreak signals while also providing robustness and flexibility in establishing what signals constitute an alarm. This flexibility allows an analyst to customize the system for different syndromes

Coordinated surveillance system under the One Health approach for cross-border pathogens that threaten the Union - options for sustainable surveillance strategies for priority pathogens

This report provides guidance for Member states who plan to submit applications under the work programme 'CP-g-22-04.01 Direct grants to Member States' authorities'. The priority pathogens on which the coordinated surveillance under the grant initiative shall focus have been identified in a prioritisation exercise with Member States and ECDC. These are Crimean Congo haemorrhagic fever, echinococcosis, hepatitis E, highly pathogenic avian influenza (HPAI), influenza in swine, Lyme disease, Q-fever, Rift Valley fever, tick-borne encephalitis, West Nile fever and Disease X (Disease Y of animals). Surveillance activities (surveillance cards) have been proposed for these agents in this report. Member States should select one or more diseases from the list of priority diseases and then choose surveillance activities from the surveillance cards and modify them where needed, to reflect their national needs and situation. Member States can also design alternative surveillance activities for the priority infectious agents that may better fit the epidemiological situation in their country. Further, this report provides a section on surveillance perspectives that links infectious agents to different hosts, allowing Member States to consider the testing for multiple infectious agents in samples from a single host population, as well as sections providing guidance on surveillance in vectors and wildlife and for Disease X (Disease Y in animals). Member States are encouraged to develop cross-sectoral collaborations and the report provides guidance on cross-sectoral collaboration to help them. Finally, there is a roadmap providing an overall description of the steps in the process of developing a surveillance system in order to apply for the grant.</p

Vector-borne disease surveillance in livestock populations: A critical review of literature recommendations and implemented surveillance (BTV-8) in five European countries

Preparedness against vector-borne threats depends on the existence of a long-term, sustainable surveillance of vector-borne disease and their relevant vectors. This work reviewed the availability of such surveillance systems in five European countries (Denmark, France, The Netherlands, Sweden and United Kingdom, part of the CoVetLab network). A qualitative assessment was then performed focusing on surveillance directed particularly to BTV-8. Information regarding surveillance activities were reviewed for the years 2008 and 2012. The results were then complemented with a critical scoping review of the literature aimed at identifying disease surveillance strategies and methods that are currently suggested as best suited to target vector-borne diseases in order to guide future development of surveillance in the countries in question. Passive surveillance was found to be efficient for early detection of diseases during the early phase of introduction into a free country. However, its value diminished once the disease has been established in a territory. Detection of emerging diseases was found to be very context and area specific, and thus active surveillance designs need to take the available epidemiological, ecological and entomological information into account. This was demonstrated by the effectiveness of the bulk milk surveillance in detecting the first case in Sweden, highlighting the need for output based standards to allow the most effective, context dependent, surveillance strategies to be used. Preparedness was of fundamental importance in determining the timeliness of detection and control in each country and that this in turn was heavily influenced by knowledge of emerging diseases in neighboring countries. Therefore it is crucial to share information on outbreaks between researchers and decision-makers and across borders continuously in order to react timely in case of an outbreak. Furthermore, timely reaction to an outbreak was heavily influenced by availability of control measures (vaccines), which is also strengthened if knowledge is shared quickly between countries. The assessment of the bluetongue surveillance in the affected countries showed that the degree of voluntary engagement varied, and that it is important to engage the publicby general awareness and dissemination of results. The degree of engagement will also aid in establishing a passive surveillance system

Exploratory analysis of methods for automated classification of laboratory test orders into syndromic groups in veterinary medicine

Background: Recent focus on earlier detection of pathogen introduction in human and animal populations has led to the development of surveillance systems based on automated monitoring of health data. Real- or near real-time monitoring of pre-diagnostic data requires automated classification of records into syndromes-syndromic surveillance-using algorithms that incorporate medical knowledge in a reliable and efficient way, while remaining comprehensible to end users. Methods: This paper describes the application of two of machine learning (Naïve Bayes and Decision Trees) and rule-based methods to extract syndromic information from laboratory test requests submitted to a veterinary diagnostic laboratory. Results: High performance (F1-macro = 0.9995) was achieved through the use of a rule-based syndrome classifier, based on rule induction followed by manual modification during the construction phase, which also resulted in clear interpretability of the resulting classification process. An unmodified rule induction algorithm achieved an F1-micro score of 0.979 though this fell to 0.677 when performance for individual classes was averaged in an unweighted manner (F1-macro), due to the fact that the algorithm failed to learn 3 of the 16 classes from the training set. Decision Trees showed equal interpretability to the rule-based approaches, but achieved an F1-micro score of 0.923 (falling to 0.311 when classes are given equal weight). A Naïve Bayes classifier learned all classes and achieved high performance (F1-micro = 0.994 and F1-macro =. 955), however the classification process is not transparent to the domain experts. Conclusion: The use of a manually customised rule set allowed for the development of a system for classification of laboratory tests into syndromic groups with very high performance, and high interpretability by the domain experts. Further research is required to develop internal validation rules in order to establish automated methods to update model rules without user input

Syndromic surveillance using veterinary laboratory data : data pre-processing and algorithm performance evaluation

Diagnostic test orders to an animal laboratory were explored as a data source for monitoring trends in the incidence of clinical syndromes in cattle. Four years of real data and over 200 simulated outbreak signals were used to compare pre-processing methods that could remove temporal effects in the data, as well as temporal aberration detection algorithms that provided high sensitivity and specificity. Weekly differencing demonstrated solid performance in removing day-of-week effects, even in series with low daily counts. For aberration detection, the results indicated that no single algorithm showed performance superior to all others across the range of outbreak scenarios simulated. Exponentially weighted moving average charts and Holt-Winters exponential smoothing demonstrated complementary performance, with the latter offering an automated method to adjust to changes in the time series that will likely occur in the future. Shewhart charts provided lower sensitivity but earlier detection in some scenarios. Cumulative sum charts did not appear to add value to the system; however, the poor performance of this algorithm was attributed to characteristics of the data monitored. These findings indicate that automated monitoring aimed at early detection of temporal aberrations will likely be most effective when a range of algorithms are implemented in parallel

Retrospective time series analysis of veterinary laboratory data : Preparing a historical baseline for cluster detection in syndromic surveillance

The practice of disease surveillance has shifted in the last two decades towards the introduction of systems capable of early detection of disease. Modern biosurveillance systems explore different sources of pre-diagnostic data, such as patient's chief complaint upon emergency visit or laboratory test orders. These sources of data can provide more rapid detection than traditional surveillance based on case confirmation, but are less specific, and therefore their use poses challenges related to the presence of background noise and unlabelled temporal aberrations in historical data. The overall goal of this study was to carry out retrospective analysis using three years of laboratory test submissions to the Animal Health Laboratory in the province of Ontario, Canada, in order to prepare the data for use in syndromic surveillance. Daily cases were grouped into syndromes and counts for each syndrome were monitored on a daily basis when medians were higher than one case per day, and weekly otherwise. Poisson regression accounting for day-of-week and month was able to capture the day-of-week effect with minimal influence from temporal aberrations. Applying Poisson regression in an iterative manner, that removed data points above the predicted 95th percentile of daily counts, allowed for the removal of these aberrations in the absence of labelled outbreaks, while maintaining the day-of-week effect that was present in the original data. This resulted in the construction of time series that represent the baseline patterns over the past three years, free of temporal aberrations. The final method was thus able to remove temporal aberrations while keeping the original explainable effects in the data, did not need a training period free of aberrations, had minimal adjustment to the aberrations present in the raw data, and did not require labelled outbreaks. Moreover, it was readily applicable to the weekly data by substituting Poisson regression with moving 95th percentiles

Social and ethical implications of data and technology use on farms: a qualitative study of Swedish dairy and pig farmers

IntroductionLivestock farmers are being increasingly encouraged to adopt digital health technologies on their farms. Digital innovations may have unintended consequences, but there tends to be a pro-innovation bias in previous literature. This has led to a movement towards “responsible innovation,” an approach that questions the social and ethical challenges of research and innovation. This paper explores the social and ethical issues of data and technologies on Swedish dairy and pig farms from a critical perspective.MethodsSix focus groups were conducted with thirteen dairy and thirteen pig farmers. The data were analysed using reflexive thematic analysis and a digital critical health lens, which focuses on concepts of identity and power.Results and discussionThe analysis generated four themes: extending the self, sense of agency, quantifying animals, and managing human labour. The findings suggest that technologies can change and form the identities of farmers, their workers, and animals by increasing the visibility of behaviours and bodies through data collection. Technologies can also facilitate techniques of power such as conforming to norms, hierarchical surveillance, and segregation of populations based on data. There were many contradictions in the way that technology was used on farms which suggests that farmers cannot be dichotomised into those who are opposed to and those that support adoption of technologies. Emotions and morality played an important role in the way animals were managed and technologies were used by farmers. Thus, when developing innovations, we need to consider users’ feelings and attachments towards the technologies. Technologies have different impacts on farmers and farm workers which suggests that we need to ensure that we understand the perspectives of multiple user groups when developing innovations, including those that might be least empowered